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DETAILED ACTION 

The response received on 1/22/2010 has been placed in the file and was 
considered by the examiner. An action on the merit follows. 

Response to Amendment 

1 . The amendments filed on 22 January 201 0 have been fully considered. 
Response to these amendments is provided below. 

Summary of Amendment/ Arguments and Examiner's Response: 

2. The applicant has amended the claims to include limitations regarding reducing 
the resolution of the image. The applicant provides arguments that the prior art does 
not teach the amended limitations. 

3. Applicant's arguments with respect to the claims have been considered but are 
moot in view of the new ground(s) of rejection. 

Information Disclosure Statement 

4. The information disclosure statement filed 1 1/10/2009 fails to comply with 37 
CFR 1 .98(a)(2), which requires a legible copy of each cited foreign patent document; 
each non-patent literature publication or that portion which caused it to be listed; and all 
other information or that portion which caused it to be listed. It has been placed in the 
application file, but the information referred to therein has not been considered. The 
applicant has provided two references on the same date with the same assignee, but 
they are PCT/WO applications without corresponding numbers on the IDS. 
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Furthermore, the dates do not match. The examiner is unsure if the applicant intended 
to write down the references that were provided on the IDS. WO 2008/017343 and WO 
2008/023280 have been considered. 



Claim Rejections - 35 USC § 101 

5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

The USPTO "Interim Guidelines for Examination of Patent Applications for Patent 
Subject Matter Eligibility" (Official Gazette notice of 22 November 2005), Annex 
IV, reads as follows: 

In contrast, a claimed computer-readable medium encoded with a computer program is a 
computer element which defines structural and functional interrelationships between the 
computer program and the rest of the computer which permit the computer program's 
functionality to be realized, and is thus statutory See Lowry, 32 F.3d at 1583-84, 32 USPQ2d at 
1035. 

Claims that recite nothing but the physical characteristics of a form of energy, such as frequency, 
voltage, or strength of a magnetic field, define energy or magnetism, per se, and as such are 
nonstatutory natural phenomena. O'Reilly, 56 I.S. (15 How.) at 112-14. Moreover, it does not 
appear that a claim reciting a signal encoded with functional descriptive material falls within any 
of the categories of patentable subject matter set forth in Sec. 101 . 

. . .a signal does not fall within one of the four statutory classes of Sec 1 01 . 

...signal claims are ineligible for patent protection because they do not fall within any of the four 
statutory classes of Sec. 101 . 



6. Claims 41 -55, 63-73 and 83-84 are rejected under 35 U.S.C. 1 01 because the 
claimed invention is directed to non-statutory subject matter as follows. Claims 41 and 
63 are drawn to functional descriptive material recorded on one or more computer 
readable media. A computer readable medium can be defined as encompassing 
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statutory medium, but it also encompasses non-statutory subject matter such as a 
signal or carrier wave. 

A "signal" embodying functional descriptive material is neither a process nor a 
product (i.e., a tangible "thing") and therefore does not fall within one of the four 
statutory classes of §101 . Rather, "signal" is a form of energy, in the absence of any 
physical structure of tangible material. 

Because the full scope of the claim encompasses non-statutory subject matter, 
the claim as a whole is non-statutory. The examiner suggests amending the claim to "a 
non-transitory computer readable medium encoded with a computer program." Any 
amendment to the claim should be commensurate with its corresponding disclosure. 

Claim Rejections - 35 USC § 103 

7. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

8. Claims 1 and 85 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
U.S. Patent No. 5353058 (Takei) in view of U.S. Patent No. 6504546 (Cosatto et al). 

9. Regarding claim 1 , Takei discloses a method of generating on a processor-based 
digital image acquisition device one or more new digital still images using an original 
digitally-acquired still image including a face, comprising: using a processor (fig. 4) of 
the device in performing the following: (a) identifying one or more groups of pixels that 
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correspond to a face within a foreground region of the original digitally-acquired still 
image by identifying which groups of pixels/ areas have flesh colored regions that 
correspond to a face within a foreground region (fig. 1 1 A, col. 9, lines 29-32) which has 
a certain resolution, since the image will have the resolution that the camera takes, 
wherein the identifying comprises sub-sampling of the image, by dividing/ subsampling 
the image into 12 areas (col. 9, lines 29-31) and not including the area around the areas 
(fig. 6a-b) and wherein the identifying further comprises detecting the face in real time 
since the exposure control is done in the camera automatically and maintained 
throughout all times (col. 1, lines 11-15); (b) calculating a degree to which exposure of 
the face in the foreground within said image differs from a desired exposure of said face 
by finding the correction signal that corrects the values to obtain the appropriate 
exposure (col. 9, lines 30-35) within said image, including determining that said face 
lacks the desired exposure as being shadowed or shot with back light or otherwise 
insufficiently illuminated during acquisition (col. 9, lines 30-31), (c) based on the 
identifying of the one or more groups of pixels that correspond to said face and on the 
degree as a result of the calculating, selecting a portion of the original still image for 
processing to include the one or more groups of pixels, the pixels of flesh color (col. 9, 
lines 40-60); and (d) automatically generating values of pixels of one new still image 
based on the selected portion in a manner which always includes the face within the 
one or more new still images which differ from the original digitally-acquired still image 
by including at least one group of pixels modified at least in luminance of the face, the 
pixels of the face, including applying a digital fill flash to add light and to boost the 
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luminance of the face in the foreground, as compared with the one or more groups of 
pixels identified in the foreground of the original digitally-acquired still image, since the 
exposure of the face is compensated/ corrected when there is backlight, thus lightening 
the areas of the foreground/ face (col. 9, lines 40-60). 

Takai does not disclose expressly that the sub-sampling used to identify groups 
of pixels that correspond to the face is sub-sampling of the resolution of the image, 
including reducing a resolution of at least one or more portions of the image on which 
computations are performed. 

Cosatto et al discloses when identifying areas/ pixels that correspond to the face/ 
head, it is known to sub-sample the resolution of the image by reducing the resolution of 
the image/ creating strongly reduced resolution image on which computations/ the 
computations made to find the face are performed (col. 8, lines 10-15). 

Takai and Cosatto et al are combinable because they are from the same field of 
endeavor, i.e. locating faces. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to reduce the resolution of the image to find the face. 

The suggestion/motivation for doing so would have been to speed up the method 
by having less data that needs to be processed and eliminating data that does not need 
to be processed in detail. 

Therefore, it would have been obvious to combine the method of Takai with the 
subsampling of Cosatto et al to obtain the invention as specified in claim 1 . 
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10. Claim 85 is rejected for the same reasons as claim 1 . Thus, the arguments 
analogous to that presented above for claim 1 are equally applicable to claim 85. Claim 
85 distinguishes from claim 1 only in that claim 85 adds the limitation that the process is 
carried out an the portable digital camera. Takei teaches this feature, i.e. the apparatus 
is on a video camera (col. 1, lines 11-14). 

1 1 . Claims 23 and 92 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, as applied to claims 1 and 85 above, and further in 
view of U.S. Patent Application Publication No. 20040095359 (Simon et al). 

Claims 23 and 92 are rejected for the same reasons as claims 1 and 85, 
respectively. Thus, the arguments analogous to that presented above for claims 1 and 
85 are equally applicable to claims 23 and 92. Claims 23 and 92 distinguishes from 
claims 1 and 85 only in that they automatically provide an option for generating new 
values. Simon et al teaches further this feature, i.e. providing options to the user for 
generating new values (fig. 1 , step 102 and 104) 

Takei (as modified by Cosatto et al) and Simon et al are combinable because 
they are from the same field of endeavor, i.e. processing facial images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to automatically provide an option. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by allowing them to access their preferences. 
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Therefore, it would have been obvious to combine Takei (as modified by Cosatto 
et al) with the option of Simon et al to obtain the invention as specified in claims 23 and 
92. 

12. Claims 41 and 99 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, as applied to claims 1 and 85 above, and further in 
view of U.S. Patent Application Publication No. 20010005222 (Yamaguchi). 

13. Claims 41 and 99 are rejected for the same reasons as claims 1 and 85. Thus, 
the arguments analogous to that presented above for claims 1 and 85 are equally 
applicable to claims 41 and 99. Claims 41 and 99 distinguishes from claims 1 and 85 
only in that they are CRM claims instead of method claims. Yamaguchi teaches further 
this feature, i.e. that a method can be embodied on a CRM (col. 4, line 62- col. 5, line 
10); particularly a method that involves the adjustment of face data. 

Takei (as modified by Cosatto et al) and Yamaguchi are combinable because 
they are from the same field of endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to embody the method on a CRM. 

The suggestion/motivation for doing so would have been to provide a well known, 
compact and thus user friendly means to carry out the method. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al) with the CRM of Yamaguchi to obtain the invention as 
specified in claims 41 and 99. 
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14. Claims 63 and 106 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al and Yamaguchi, as applied to claims 41 and 99 
above, and further in view of and Simon. 

15. Claims 63 and 106 are rejected for the same reasons as claims 41 and 99. 
Thus, the arguments analogous to that presented above for claims 41 and 99 are 
equally applicable to claims 63 and 106. Claims 63 and 106 distinguishes from claims 
41 and 99 only in that they automatically provide an option for generating new values. 
Simon et al teaches further this feature, i.e. providing options to the user for generating 
new values (fig. 1, step 102 and 104). 

Takei (as modified by Cosatto et al and Yamaguchi) and Simon et al are 
combinable because they are from the same field of endeavor, i.e. processing facial 
images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to automatically provide an option. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by allowing them to access their preferences. 

Therefore, it would have been obvious to combine Takei (as modified by Cosatto 
et al and Yamaguchi) with the option of Simon et al to obtain the invention as specified 
in claims 63 and 106. 
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16. Claims 2-5, 42-45, 86-89, and 100-103 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Takei in view of Cosatto et al and Yamaguchi, and further in 
view of U.S. Patent No. 4970663 (Bedell et al). 

1 7. Regarding claim 2, Takei (as modified by Cosatto et al) discloses all of the 
claimed elements as set forth above and incorporated herein by reference. 

Takei (as modified by Cosatto et al) does not disclose expressly (e) gradually 
displaying a transformation between said original image and the new image. 

Yamaguchi discloses when transforming images, displaying the original image 
(page 3, paragraph 48) and displaying the final image (fig. 1 1 , s234). Thus, Yamaguchi 
discloses displaying a transformation between these images since both images are 
displayed. 

Takei (as modified by Cosatto et al) and Yamaguchi are combinable because 
they are from the same field of endeavor, i.e. processing facial images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to display the transformation between images. 

The suggestion/ motivation for doing so would have been to provide a more user- 
friendly system by allowing the user to review the transformation. 

Takei (as modified by Cosatto et al and Yamaguchi) does not disclose expressly 
the gradual display of the transformation. 

Bedell et al discloses displaying another type of transformation between the 
images when disclosing that images can be dissolved from one image to another (col. 
4, lines 19-20). 
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Takei (as modified by Cosatto et al and Yamaguchi) and Bedell et al are 
combinable because they are from the same field of endeavor, i.e. manipulating 
images. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to display a gradual transformation. 

The suggestion/motivation for doing so would have been to provide a more user 
friendly system by allowing the user a pleasing way to view the transformation. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al) with the display of both images of Yamaguchi and the gradual 
display of Bedell et al to obtain the invention as specified in claim 2. 

18. Regarding claim 3, Takei discloses adjusting parameters, the exposure 
parameters (col. 9, lines 35-40), of said transformation between the original image and 
the new image. Bedell discloses other parameters, as seen in the rejection for claim 4, 
below. 

1 9. Regarding claim 4, Bedell et al discloses that parameters of said transformation 
between images are being selected from a set of criteria including timing, the number of 
frames it takes to dissolve and blending, the blending of the frames as one frame 
dissolves into another (col. 4, lines 21-25). 

20. Regarding claim 5, Bedell et al discloses blending includes dissolving (col. 4, 
lines 19-20). 

21 . Claims 42-45 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
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applicable to claims 42-45. Claims 42-45 distinguishes from claims 2-5 only in that they 
have different dependencies, both of which have been previously rejected. Therefore, 
prior art applies. 

22. Claims 86-89 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
applicable to claims 86-89. Claims 86-89 distinguishes from claims 2-5 only in that they 
have different dependencies, both of which have been previously rejected. Therefore, 
prior art applies. 

23. Claims 100-103 are rejected for the same reasons as claims 2-5, respectively. 
Thus, the arguments analogous to that presented above for claims 2-5 are equally 
applicable to claims 100-103. Claims 100-103 distinguishes from claims 2-5 only in that 
they have different dependencies, both of which have been previously rejected. 
Therefore, prior art applies. 

24. Claims 6 and 46 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) as applied to claims 5, 
45, 89 and 103 above, and further in view of U.S. Patent No. 20030123751 
(Krishnamurthy et al). 

25. Regarding claim 6, Takei (as modified by Cosatto et al, Yamaguchi and Bedell et 
al) discloses all of the claimed elements as set forth above and incorporated herein by 
reference. 
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Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) does not 
disclose expressly that the selected portion further comprises a zoom region, and a new 
image comprising a zoomed image includes the face enlarged by zooming. 

Krishnamurthy et al discloses a selected portion, or the region of interest (fig. 2, 
item 210), further comprises a zoom region, since the region of interest is zoomed in on, 
(fig. 2, item 240), and a new image comprising a zoomed image includes the face 
enlarged by the zooming (fig. 2, item 240), since the face is included in the region of 
interest (pg. 1, pp. 0009). 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) and 
Krishnamurthy et al are combinable because they are from the same field of endeavor, 
i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to have the capability of zooming in on the face. 

The suggestion/motivation for doing so would have been more robust system by 
allowing images to be taken from far away. 

Therefore, it would have been obvious to combine Takei (as modified by Cosatto 
et al, Yamaguchi and Bedell et al) with the zooming of Krishnamurthy et al to obtain the 
invention as specified in claim 6. 

26. Claim 46 is rejected for the same reasons as claim 6. Thus, the arguments 
analogous to that presented above for claim 6 are equally applicable to claim 46. Claim 
6 distinguishes from claim 46 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 
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27. Claim 90 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al, Yamaguchi and Bedell et al, as applied to claim 89 above, and 
further in view of U.S. Patent No.6246779 (Fukui et al). 

Regarding claim 90, Takei (as modified by Cosatto et al, Yamaguchi and Bedell 
et al) discloses all of the claimed elements as set forth above, and incorporated herein 
by reference. 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) does not 
disclose expressly determining a point of rotation and an amount of rotation after which 
another image is automatically generated including a rotated version of the face. 

Fukui et al discloses determining a point of rotation, a rotation pivot point (col. 7, 
line 31) and an amount of rotation theta (col. 7, line 40) after which another image is 
automatically generated including a rotated, transformed version of the face (col. 7, 
lines 41- col. 8, line 4). 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) and Fukui et al 
are combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
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can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al, Yamaguchi and Bedell et al) with the rotation of Fukui et al to 
obtain the invention as specified in claim 90. 

28. Claim 104 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei 
in view of Cosatto et al and Yamaguchi, and further in view of Fukui. 

Regarding claim 104, Takei (as modified by Cosatto et al and Yamaguchi) 
discloses all of the claimed elements as set forth above, and incorporated herein by 
reference. 

Takei (as modified by Cosatto et al and Yamaguchi) does not disclose expressly 
determining a point of rotation and an amount of rotation such that the generating of the 
values of the pixels automatically generates a new image including a rotated version of 
the face by rotating the image about said point of rotation by said amount of rotation. 

Fukui et al discloses a step of determining a point of rotation, a rotation pivot 
point (col. 7, line 31) and an amount of rotation theta (col. 7, line 40) such that the 
generating of the values of the pixels automatically generates a new image, a 
transformed version of the face, including a rotated version of the face by rotating the 
image about said point of rotation by said amount of rotation (col. 7, lines 41- col. 8, line 
4. 
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Takei (as modified by Cosatto et al and Yamaguchi) and Fukui et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al and Yamaguchi) with the rotation of Fukui et al to obtain the 
invention as specified in claim 104. 

29. Claims 7, 1 1 , 47 and 51 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Takei (in view of Cosatto et al, Yamaguchi, Bedell et al, and 
Krishnamurthy et al) and further in view of Fukui. 

30. Claims 7 and 47 are rejected for the same reasons as claim 90. Thus, the 
arguments analogous to that presented above for claim 90 are equally applicable to 
claims 7 and 47. Claims 7 and 47 distinguish from claim 90 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

31 . Claims 1 1 and 51 are rejected for the same reasons as claim 1 04. Thus, the 
arguments analogous to that presented above for claim 104 are equally applicable to 
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claims 1 1 and 51 . Claims 1 1 and 51 distinguish from claim 104 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

32. Claim 81 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al, and further in view of Krishnamurthy. 

33. Takei (as modified by Cosatto et al) discloses all of the claimed elements as set 
forth above and incorporated herein by reference. 

Takei (as modified by Cosatto et al) does not disclose expressly the one or more 
new still images comprise a plurality of new still images; Takei only adjusts the one 
image regarding the facial exposure. 

Krishnamurthy et al discloses another new image that can be generated from a 
selected portion, or the region of interest (fig. 2, item 210), comprising a zoom region, 
since the region of interest is zoomed in on, (fig. 2, item 240), and a new image 
comprising a zoomed image includes the face enlarged by the zooming (fig. 2, item 
240), since the face is included in the region of interest (pg. 1 , pp. 0009). With the 
additional zooming of Krishnamurthy, a plurality of images is generated. 

Takei and Krishnamurthy et al are combinable because they are from the same 
field of endeavor, i.e. facial image processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to have the capability of zooming in on the face in addition to exposure 
compensation. 
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The suggestion/motivation for doing so would have been more robust system by 
allowing images to be taken from far away. 

Therefore, it would have been obvious to combine the method of exposure 
compensation of Takei with the zooming of Krishnamurthy to obtain the invention as 
claimed in claim 81 . 

34. Claim 82 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al and Simon, as applied to claim 23 above, and further in view of 
Krishnamurthy et al. 

35. Claim 82 is rejected for the same reasons as claim 81 . Thus, the arguments 
analogous to that presented above for claim 81 are equally applicable to claim 82. 
Claim 82 distinguishes from claim 81 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 

36. Claim 83 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al and Yamaguchi, as applied to claim 41 above, and further in view 
of Krishnamurthy et al. Claim 83 is rejected for the same reasons as claim 81 . Thus, 
the arguments analogous to that presented above for claim 81 are equally applicable to 
claim 83. Claim 83 distinguishes from claim 81 only in that they have different 
dependencies, both of which have been previously rejected. Therefore, prior art 
applies. 
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37. Claims 84 and 1 1 2 are rejected under 35 U.S.C. 1 03(a) as being unpatentable 
over Takei in view of Cosatto et al, Yamaguchi and Simon, as applied to claim 63 
above, and further in view of Krishnamurthy et al. 

38. Claims 84 and 1 1 2 are rejected for the same reasons as claim 81 . Thus, the 
arguments analogous to that presented above for claim 81 are equally applicable to 
claims 84 and 1 12. Claims 84 and 1 1 2 distinguishes from claim 81 only in that they 
have different dependencies, both of which have been previously rejected. Therefore, 
prior art applies. 

39. Claim 105 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei 
in view of Cosatto et al and Yamaguchi, as applied to claim 99 above, and further in 
view of U.S. Patent Application Publication No. 20030142209 (Yamazaki et al). 

40. Takei (as modified by Cosatto et al and Yamaguchi) disclose all of the claimed 
elements as set forth above and incorporated herein by reference. 

Takei (as modified by Cosatto et al and Yamaguchi) does not disclose expressly 
generating a panning sequence comprising a sequence of at least two of the original 
image and the one or more new images. 

Yamazaki et la discloses generating of the values by generating one or more 
new images (fig. 2, items 3-3 to 3-5) each including a new group of pixels corresponding 
to the face, the face being shown in fig. 2, items 3-3 to 3-5 and the new group of pixels 
being the changes in the face in the new images, and further comprising the step of 
generating a panning sequence (pg. 2, pp. 21) which keeps the object of interest in the 
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center, comprising a sequence of at least two of the original images (fig. 3, items 3-2 to 
3-3) and the one or more new images (fig. 3-4). 

Takei (as modified by Cosatto et al and Yamaguchi) and Yamazaki et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to pan in new images. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by automatically following an object of interest instead of manually 
following, and to increase speed by following the object instead of asking the user to 
find the object when it moves. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al and Yamaguchi) with Yamazaki et al to obtain the invention as 
specified in claim 105. 

41 . Claim 91 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al, Yamaguchi and Bedell et al, and further in view of Yamazaki et al. 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) discloses all of 
the claimed elements as set forth above and incorporated herein by reference. 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) does not 
disclose expressly (g) determining one or more further new images each including a 
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new group of pixels corresponding to the face; and (h) automatically panning using the 
one or more further new images. 

Yamazaki et al discloses determining one or more further new images each 
including a new group of pixels corresponding to the face by obtaining more images 
over time that include the face (fig. 3, item 3-3 to 3-5). And automatically panning using 
one or more further new images, as can be seen in items 3.3 to 3.5, since the person 
moves and the camera keeps the person in the center, thus panning (pg. 2, pp. 21). 

Takei (as modified by Cosatto et al, Yamaguchi and Bedell et al) and Yamazaki 
et al are combinable because they are from the same field of endeavor, i.e. facial image 
processing. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to pan in new images. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by automatically following an object of interest instead of manually 
following, and to increase speed by following the object instead of asking the user to 
find the object when it moves. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by Cosatto et al, Yamaguchi and Bedell et al) with Yamazaki et al to obtain the 
invention as specified in claim 91 . 
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42. Claims 8, 9, 14-15, 48, 49, 54 and 55 are rejected under 35 U.S.C. 103(a) as 
being unpatentable overTakei, Cosatto etal, Yamaguchi, Bedell and Krishnamurthy 
and further in view of Yamazaki et al. 

43. Claims 8 and 14 are rejected for the same reasons as claims 91 and 105, 
respectively. Thus, the arguments analogous to that presented above for claims 91 and 
105 are equally applicable to claims 8 and 14. Claims 8 and 14 distinguish from claims 
91 and 105 only in that they have different dependencies, both of which have been 
previously rejected. Therefore, prior art applies. 

44. Claims 48 and 54 are rejected for the same reasons as claims 91 and 105, 
respectively. Thus, the arguments analogous to that presented above for claims 91 and 
105 are equally applicable to claims 48 and 54. Claims 48 and 54 distinguish from 
claims 91 and 105 only in that they have different dependencies, both of which have 
been previously rejected. Therefore, prior art applies. 

45. Regarding claim 9, Yamazaki et al discloses each of the one or more further new 
images including pixels corresponding to features different from at least one other 
image of the one or more further new images, such features being the differences in the 
image from movement, such as the movement of the door and the pixels corresponding 
to the movement (fig. 3, items 3-2 to 3-5). 

46. Claims 15, 49, and 55 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 15, 49, and 55. Claims 15, 49, and 55 distinguish from claim only in that they 



Application/Control Number: 10/608,784 
Art Unit: 2624 

have different dependencies, all of which 
prior art applies. 
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been previously rejected. Therefore, 



47. Claims 10, 12, 13, 50, 52 and 53 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takei (as modified by of Cosatto et al, Yamaguchi, Bedell et al and 
Krishnamurthy) and further in view of Yamazaki, as applied to claims 8 and 48 and 
Fukui et al, as applied to claims 1 1 and 51 . 

Regarding claim 10, Takei (as modified by of Cosatto et al, Yamaguchi, Bedell et 
al, Krishnamurthy and Yamazaki) discloses all of the claimed elements as set forth 
above, and incorporated herein by reference. 

Takei (as modified by of Cosatto et al, Yamaguchi, Bedell et al, Krishnamurthy 
and Yamazaki) does not disclose expressly determining a point of rotation and an 
amount of rotation after which another image is automatically generated including a 
rotated version of the face. 

Fukui et al discloses determining a point of rotation, a rotation pivot point (col. 7, 
line 31) and an amount of rotation theta (col. 7, line 40) after which another image is 
automatically generated including a rotated, transformed version of the face (col. 7, 
lines 41- col. 8, line 4). 

Takei (as modified by of Cosatto et al, Yamaguchi, Bedell et al, Krishnamurthy 
and Yamazaki) and Fukui et al are combinable because they are from the same field of 
endeavor, i.e. facial image processing. 
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At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to rotate the face. 

The suggestion/motivation for doing so would have been to provide a more user- 
friendly system by providing a means to obtain a normalized version of the face which 
can be used in more effectively in many applications such as image matching, or simply 
be used as a better fit to the display. 

Therefore, it would have been obvious to combine the method of Takei (as 
modified by of Cosatto et al, Yamaguchi, Bedell et al, Krishnamurthy and Yamazaki) 
with Fukui et al to obtain the invention as specified in claim 10. 

48. Claim 50 is rejected for the same reasons as claim 1 0. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 50. 
Claim 50 distinguishes from claim 10 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 

49. Regarding claim 12, Takei (as modified by Cosatto et al, Yamaguchi, Bedell, 
Krishnamurthy and Fukui) discloses all of the claimed elements as set forth above, and 
incorporated herein by reference. Takei (as modified by Cosatto et al, Yamaguchi, 
Bedell, Krishnamurthy and Fukui) does not disclose expressly (d) determining one or 
more further new images each including a new group of pixels corresponding to the 
face; and (e) automatically panning using the one or more further new images. 
Yamazaki et al discloses determining one or more further new images each including a 
new group of pixels corresponding to the face by obtaining more images over time that 
include the face (fig. 3, item 3-3 to 3-5). And automatically panning using one or more 
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further new images, as can be seen in items 3.3 to 3.5, since the person moves and the 
camera keeps the person in the center, thus panning (pg. 2, pp. 21). Takei (as modified 
by Cosatto et al, Yamaguchi, Bedell, Krishnamurthy and Fukui) and Yamazaki et al are 
combinable because they are from the same field of endeavor, i.e. facial image 
processing. At the time of the invention, it would have been obvious to a person of 
ordinary skill in the art to pan in new images. The suggestion/motivation for doing so 
would have been to provide a more user-friendly system by automatically following an 
object of interest instead of manually following, and to increase speed by following the 
object instead of asking the user to find the object when it moves. Therefore, it would 
have been obvious to combine the method of Takei (as modified by Cosatto et al, 
Yamaguchi, Bedell, Krishnamurthy and Fukui) with Yamazaki et al to obtain the 
invention as specified in claim 12. 

50. Claim 52 is rejected for the same reasons as claim 12. Thus, the arguments 
analogous to that presented above for claim 12 are equally applicable to claim 52. 
Claim 52 distinguishes from claim 10 only in that they have different dependencies, both 
of which have been previously rejected. Therefore, prior art applies. 

51 . Claims 1 3 and 53 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 13 and 53. Claim 13 and 53distinguish from claim 9 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 
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52. Claims 32, 33, and 98 rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al and Simon, as applied to claims 23 and 92 above, 
and further in view of Yamazaki et al. 

53. Claims 32 and 98 are rejected for the same reasons as claim 14. Thus, the 
arguments analogous to that presented above for claim 14 are equally applicable to 
claims 32 and 98. Claims 32 and 98 distinguish from claim 14 only in that claims 32 
and 98 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

54. Claim 33 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 33. Claim 
33 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

55. Claims 72, 73, 110 and 111 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takei in view of Cosatto et al, Yamaguchi and Simon, as applied to 
claims 63 and 101 above, and further in view of Yamazaki et al. 

56. Claims 72 and 1 10 are rejected for the same reasons as claim 14. Thus, the 
arguments analogous to that presented above for claim 14 are equally applicable to 
claims 72 and 110. Claims 72 and 1 10 distinguish from claim 14 only in that claims 72 
and 110 provide options for continuing processing. Simon teaches further this feature, 
as discussed above. 

57. Claims 73 and 111 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
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claims 73 and 111. Claims 73 and 1 1 1 distinguish from claim only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

58. Claims 29 and 96 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei (as modified by Cosatto et al and Simon), as applied to claims 23 and 92 
above, and further in view of Fukui. 

59. Claims 29 and 96 are rejected for the same reasons as claim 1 1 . Thus, the 
arguments analogous to that presented above for claim 1 1 are equally applicable to 
claims 29 and 96. Claims 29 and 96 distinguishes from claim 1 1 only in that claims 29 
and 96 provide an option to generate a new image. Simon teaches further this feature, 
as discussed above. 

60. Claims 69 and 107 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, Yamaguchi and Simon, as applied to claims 63 and 
1 01 above, and further in view of Fukui. 

61 . Claims 69 and 1 07 are rejected for the same reasons as claim 1 1 . Thus, the 
arguments analogous to that presented above for claim 1 1 are equally applicable to 
claims 69 and 107. Claims 69 and 107 distinguishes from claim 1 1 only in that claims 
69 and 107 provide an option to generate a new image. Simon teaches further this 
feature, as discussed above. 
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62. Claims 30-31 and 97 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, Simon and Fukui, as applied to claims 23 and 92 
above, and further in view of Yamazaki et al. 

63. Claims 30 and 97 are rejected for the same reasons as claim 1 2. Thus, the 
arguments analogous to that presented above for claim 12 are equally applicable to 
claims 30 and 97. Claims 30 and 97distinguishes from claim 12 only in that claims 30 
and 97 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

64. Claim 31 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 31 . Claim 
31 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

65. Claims 70-71 and 108-109 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Takei in view of Cosatto et al, Yamaguchi, Simon and Fukui, as 
applied to claims 63 and 101 above, and further in view of Yamazaki et al. 

66. Claims 70 and 108 are rejected for the same reasons as claim 12. Thus, the 
arguments analogous to that presented above for claim 12 are equally applicable to 
claims 70 and 108. Claims 70 and 108distinguishes from claim 12 only in that claims 70 
and 108 provide options for continuing processing. Simon teaches further this feature, 
as discussed above. 
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67. Claims 71 and 109 are rejected for the same reasons as claim 9. Thus, the 
arguments analogous to that presented above for claim 9 are equally applicable to 
claims 71 and 109. Claims 71 and 109 distinguish from claim 9 only in that they have 
different dependencies, all of which have been previously rejected. Therefore, prior art 
applies. 

68. Claims 24 and 93 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al and Simon, as applied to claims 23 and 92 above, 
and further in view of Krishnamurthy et al. 

69. Claims 24 and 93 are rejected for the same reasons as claim 6. Thus, the 
arguments analogous to that presented above for claim 6 are equally applicable to 
claims 24 and 93. Claims 24 and 93 distinguish from claim 6 only in that they have 
different dependencies, both of which have been previously rejected. Therefore, prior 
art applies. 

70. Claim 64 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al, Yamaguchi and Simon, as applied to claim 63 above, and further 
in view of Krishnamurthy et al. 

71 . Claim 64 is rejected for the same reasons as claim 6. Thus, the arguments 
analogous to that presented above for claim 6 are equally applicable to claim 64. Claim 
64 distinguishes from claim 6 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 
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72. Claims 25 and 94 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, Simon and Krishnamurthy, as applied to claims 24 
and 93 above, and further in view of Fukui. 

73. Claims 25 and 94 are rejected for the same reasons as claim 7. Thus, the 
arguments analogous to that presented above for claim 7 are equally applicable to 
claims 25 and 94. Claims 25 and 94 distinguish from claim 7 only in that they have 
different dependencies, both of which have been previously rejected. Therefore, prior 
art applies. 

74. Claim 65 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei in 
view of Cosatto et al, Yamaguchi, Simon and Krishnamurthy, as applied to claim 64 
above, and further in view of Fukui. 

75. Claim 65 is rejected for the same reasons as claim 7. Thus, the arguments 
analogous to that presented above for claim 7 are equally applicable to claim 65. Claim 
65 distinguishes from claim 7 only in that they have different dependencies, both of 
which have been previously rejected. Therefore, prior art applies. 
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76. Claims 26, 27 and 95 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, Simon and Krishnamurthy, as applied to claims 24 
and 93 above, and further in view of Yamazaki et al. 

77. Claims 26 and 95 are rejected for the same reasons as claim 8. Thus, the 
arguments analogous to that presented above for claim 8 are equally applicable to 
claims 26 and 95. Claims 26 and 95 distinguishes from claim 8 only in that claims 26 
and 95 provide options for continuing processing. Simon teaches further this feature, as 
discussed above. 

78. Claim 27 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 27. Claim 
27 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

79. Claims 66 and 67 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Takei in view of Cosatto et al, Yamaguchi, Simon and Krishnamurthy, as applied to 
claims 64 above, and further in view of Yamazaki et al. 

80. Claim 66 is rejected for the same reasons as claim 8. Thus, the arguments 
analogous to that presented above for claim 8 are equally applicable to claim 66. Claim 
66 distinguishes from claim 8 only in that claim 66 provides options for continuing 
processing. Simon teaches further this feature, as discussed above. 

81 . Claim 67 is rejected for the same reasons as claim 9. Thus, the arguments 
analogous to that presented above for claim 9 are equally applicable to claim 67. Claim 
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67 distinguishes from claim 9 only in that they have different dependencies, all of which 
have been previously rejected. Therefore, prior art applies. 

82. Claim 28 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei, 
Cosatto et al, Simon, Krishnamurthy and Yamazaki as applied to claim 26 above, and 
further in view of Fukui. 

83. Claim 28 is rejected for the same reasons as claim 10. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 28. 
Claim 28 distinguishes from claim 10 only in that they have different dependencies, all 
of which have been previously rejected. Therefore, prior art applies. 

84. Claim 68 is rejected under 35 U.S.C. 103(a) as being unpatentable over Takei, 
Cosatto et al, Yamaguchi, Simon, Krishnamurthy and Yamazaki as applied to claims 26 
and 66 above, and further in view of Fukui. 

85. Claim 68 is rejected for the same reasons as claim 10. Thus, the arguments 
analogous to that presented above for claim 10 are equally applicable to claim 68. 
Claim 68 distinguishes from claim 10 only in that they have different dependencies, all 
of which have been previously rejected. Therefore, prior art applies. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to KATHLEEN S. YUAN whose telephone number is 
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(571 )272-2902. The examiner can normally be reached on Monday to Thursdays, 9 AM 
to 5 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on (571)272-7453. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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